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A'BSTBACT 

This paper reports on the development of an 
error-coding 'instrument and a' computerized continuous feedback system 
for the diagnostic evaluation and remedial treatment of unstructured 
second-language performances and the use of such a sy^em in an 
instructional 1 setting. The system does the following: irt^llows 
quick^. objective^ accurate, and detailed evaluation of "creative" 
written and spoken German; it provides student performance files in 
the structural and phonological elements of the language that can be 
updated as required; it allows accurate performance-to-performance 
comparisons of progress; it permits the instructor to determine 
quickly the learning status of an individual student, a groUp of 
-students, or the entire class, and subsequently to design appropriate 
exercises for that particular target group; and it allows students to 
jud^e their performance from tha^ same criteria which were available 
to their instructor for marking^^ Feedback procedures and a tabulation 
of errors for three levels of German language instruction are 
presented and their systemic implications for the design of 
pedagogical grammars are discussed^. (Author/KH) 
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^ ' Introduc tion 

ITS' ■ — . 

I should like to report to you on the development of an 

HI error-coding instrument and a continuous-feedback system for the 

D diagnostic evaluation and remedial treatment of unstructured 

second-language perf ofmances the use of such a system in an . 

instructional setting^ 

* - . ■' 

The notion of performance analysis arises from seveiral con- 

j temporary concerns in second-language teaching which,. in myy 

opinion, requi-^e a restructuring of traditional approaches ^to 

the evaluation of student learning. These issues are error ' 

r analysis, a distinction between the concepts of competence and 

performance, an insistence on meaningful practice in real com- 

munication, and a related emphasis on individuali25ation of in- 

struction by specification of performance objectives. 

. Because of the time limitations here I cannot /discuss in de- 

t^l the research background and the relevant professional lit- , 

^ erature; instead I will outline the principles involved in the 

Ll form of generalizing statements which embody current research. 

■ ' ■'■'*' 
Research background 

(1) Because of recent psycholinguistic insights in language 

acquisition and language Use, the strong claim of contrastive 

analysis for exhaustive predictive power has been replaced by 



postulating a weaker, explanatory function, and contrastiye 
analysis has been complemented by the more comprehensive cpn- 
cept of error analysis. This notion has had immense effects on 
applied linguistics "theory" as well as on second-language teach- 
ing itself/ and a large number of books and articles .have been 
devoted to a theoretical analysis of the issues and their peda- 
gogical implications. (e.g. Corder, 1967; Duskova, 1969; 
Wardhaugh, 1970; Neipser and Slama-Cazacu, 1970; Selinker, 1970; 
Buteau, 1970; Corder, 1971; Neraser, 1971; Selinker, 1971; Whit- 
man and Jackson, 1972; Richards, 1972; Selinker, 1972; Dulay 
and Burt, 1972; Politzer and Ramirez, 1973; Khampang, 1974; 
Schachter, 1974; Bailey, Madden and Krashen, 1974; Scott, 1974; 
George, 1972; Richards, 1971; Burt and' Kiparsky , 1972; Smith, 
1971;- Valdman, 1973) 

(2) Linguists deal, for the most part, with various aspects 
of competence ; language teachers have to deal, for the most part 
with its manifestation in- perfiarmanceg (Di Pietro, 19 70), but 

an analysis of a speaker- hearer's incorrect performances, it 
is claimed, can give valuable clues as to what went wrong either 
in the internalization of linguistic structure itself or in its 
representation in speech (Joiner, 1974^ p. 155; Corder, 1967; 
Quirin, 1974, p. 348; Valdman, 1973). 

(3) If a student's performance, is a realization of his com-^. 
petence ift a second language in decoding or encoding speech, 
then the aim of instruction must be the development of receptive 
and productive competence (Di Pietro, 1971, p. 19) in communica - 
tion of some sort. High organization and meaningfulness ot the 



conununi cation appear to facilitate the acquisition process 
(Oiler, 1972; Rivers, 1972 , p. 66; Savigon, 1972). ; 

(4) The teacher must be mindful of each individual student's 
process of internalization and externalization of linguistic 
competence; thai: means that he has to be aware of and sensitive 
tO' intervening cognitive, affective and psycho-motor factors 
which might facilitate or inhibit a learner's acquisition and 
production of a foreign language. 

(5) Continuous behavioral testing in relation to performance 
objectives to inform and motivate the student and to alert the 
teacher to learning problems being encountered by an individual 
student 6r by the class as a whole is virtually a necessity if 
the teacher wants to adequately guide a student's progress in 

art individualized setting (Clark, 1972, p. 227). 

(6) Traditional testing approaches have, mostly for adminis- 
trative, not pedagogical reasons^ tended to focus on an evalua- 
tion of a student's competence in structured situations (Clark, 
1972, p. 23I) , but proficiency in communication (i.e. communica- 
tive competence as well as linguistic competence) can only be 
assessed validly in situations where a student can meaningfully 
and non-mechanically interact with or at least react to a part- 
ner in communication. 

(7) Remedial learning is most effective when based on a 
systematid evaluation of such a performance. • 
Specifications of the coding and feedback system 

With these generalizations in mind, an anlysis and feedback 
system was constructed and field-tested which had to satisfy 



the criteria of exhaustiveness , explicitness , accurateness , - 

/ - ■ ' • ' ■ • 

efficiency, effectiveness and open-endedness for its structural 

\ ' ■ • 

design. 

Description of the coding and feedback systeitr 

What fo3.1ows is a description of the error-coding and feed- 
back system in general, as well as a brief illustrative report 
on its use in Beginning, Intermediate, and Advanced German lan- 
guage classes at the University of Alberta. Pertinent informa- 
tion iregard[ing the numbers of students involved, corpus size, 
and numbers of errors observed. i^s given on the Hand-out. The 
corpus was obtained from short paragraphs and essays and from 
tape-recorded, regularly scheduled conversations between students 
and the instructor. 

A general distinction was made between an error in Unguis- 

t 

tic form (e.g. "correct past tense suffix") and an error in the 
proper use of the linguistic forra^J.5A^h^ as "correct use of the 
past tense"). There were 260 codes in the linguistic form, 85 
codes in the proper use category, and 65 codes in the phonology 
group. Errors were coded, with one exception, in terms of intra- 
lingual contrasts, that is, they were cpded in terms of what 
the linguistic form or its use should have been as comjj^ared to 
what was observed. 

In order to retain optimal amounts of structural information 
eifrors were classified in a hierarchy of decreasing specificity., 
i.e. if a very specific error definition was unambiguously 
possible it was coded as such; otherwise a lower level of speci- 
ficity was employed; for example capitalization" , "correct 



ending of a noun in the dative plural" ^ "correct past tense 
suffix", ^or "correct istem of a past participle" versus "spelling" 
Unainbiguity then referred to the least amount of guessing as 
to the, student's reasons for using a certain structure ; in this 
way/ it was hoped that a non-interpretive data base could be 
assembled which, if so desired, could then be used for causal 
error analysis. Illustration 2 on the Handout provides some 
excerpts, from the coding sheet. Some of the error codes can 
be criticized as not meeting rigorous standards of linguistic 
definition; however, as was done by Politzer and Ramirez (1973)**, 
scientific precision was sacrificed occasionally for pedagog- 
ical considerations if the output was to be immediately meaning- 
ful and consequently useful to the student. ^, 
Data Processing 

After coding, the errors were processed by means of a 
specially prepared computer program which outputs the following 
information. Illustrations of each type are provided on the Hand- 
out. 

(1) An Error - Word Ratio ; By converting the number of errors 
into a ratio of errors per every one hundred words, differences 
in the length of essay^,, paragraphs or oral performances are 
compensated, for; the ratio consequently allows comparisons of 
overall performance between samplings taken from one or more 
students' performances. 

(2) Individual Error Profile : This is a list of individual 
errors for each student which is updated with a new record; it 
contains the actual number of errors, the percentage of the total 



nuniber of errors accounted for, and the verbal descriptor. The 
profile pinpoints occuocences .of specific errors for the student 
and the instructor, 

(3) Elrror Cluster Profile ; 56 clusters were compiled of 
errors which are based on a common principle and which resemble 
major headings in second- language instruction , e.g. "correct 
word order"; "correct form and/or use of relative pronouns"; 
"correct choice of word in situational context". This cluster 
analysis was devised because it is conceptually more useful to 
students and the instructor to do remedial practice in "endings 
of der-words" rather than exercises in "the accusative singular 
of a der-word after a preposition". It is clear that the remedial 
exercise will center around the actually observed cases of errors, 
but will also extend to other areas from which negative transfer 
can be expected. 

Individual Error Summary for all students at the last 
performance sample: This table summarizes all errors across all 
students in a given course and allows the instructor to tell at 
a glance which areas of structure and phonology should be dealt 
with remedially before the next sampling. 

The catega?'*y "number of students making a given error" was intro- 
duced here so that the instructor may know if , for instance, a 
given error whose frequency of actual occurrence was 5, was made 
by one student only, by two, or by five diTfferent students. The 
error dispersion number consequently permits the instructor to 
judge from the summary list if he has to administer remedial 
exerci3es to the class as a whole, to a sub-group, or to one 



student only. 

(5) In the Error Cluster Sumipary for. .all students at the 
last performance sample the instructor can isolate major groups 
of errors and their dispersion c3ver the entire class. 
Finally, summary outputs are produced cumulatively of each of 
the above types for all students in a given course and all per- 
formance samples. With these^ the instructor can keep tabs on 
the long-range development of students' progress over the school 
year and he can, on this basis,- anticipate potential problem 
&reas in subsequent years. Illustration 8 on the Hand-out pro- 
vides. an example of a Cumulative Error Summary.' 
Data feedback 

After the data collection, every attempt was made to return 
the computer print-outs to the students and the instructor as 
soon as possible; in most cases, the waiting period for the 
feedback data V7as only one^day. 

Throughout the feedback process, the emphasis was on the 
student as an active partner in evaluation rather than as the 
passive recipient of an externally imposed testing system (Clark 
1972, p. 230). Following George's (1972, pp. 73-78) discussion 
of remedial strategies, it was considered important that the 
students, as a first step in error extinction, be able to dis- 
driminate between unwanted and wanted items. Students were 
therefore asked to focus their attention on two types of data, 
viz. errors in areas in which the student had been doing re- 
medial work, and secondly, on errors in those areas which ha4^ 
recently been introduced in class. The former were to provide 

8 



feedback on the effectiveness of previous remedial learning; if 
such errors did not occur any more or in lesser frequency the 
student would presumably be positively reinforced and would, 

as a result^ be motivated to use similar strategies for new 

■» ... 

errors. Consequently, stucjents would look at remedial learning 
>^s an integral component of the total ijistructional process 
rather than as an exercise for catching up with the others in 
the class. As George (1972, p. 73) puts it, "unless the re- 
medial work r^ults in a strong sense of achievement there is 
likely to be only perfunctory performance of remedial exercises, 
and consequently little improvement". 

Conversely, of course, negative reinforcement will be pro- 
.vided if the error frequency had not diminished significantly. 
It is of great importance therefore that the instructor, by 
means of perfoxmance files, keeps track of the effectiveness 
of instruction and remediation for each individual S/tudent over 
the longer term and that he design teaching streftegies a:;cordingly . 

For an interpretation of their performance records, students 
were instructed to ignore frequencies of 1 as most of those were 
probably performance errors which they might have corrected them- 
selves if given the opportunity to do so; in any event, larger 
error frequencies are more likely to be genuine errors indicating 
deficiencies in the student's compet:^nce,.(Valette and Disick, 1972, 

43) . As the next step, students checked the invdividual error 
p:r6files for persistent occurrence of incorrect items. The process 
of cognitive focussing was continued by having the students try 
to become clear in their minds, either on thei^r own or with the 



/ 

help of the instructor, about the question what the correct 
form or usage should have been; then the students were asked 
to test out their r,hew insight in practice, and finally, students 
were told to concentrate on the correct use of that particul^ar 
item at the next written or. oral performance sampling. 

The instructor proceeded similarly in the interpretation 
of the data. He checked the error profile for tire class as a 
whole ^d noted major error frequencies and the number of students 
making a certain erroic. Then he analyzed the cumulative records* 
of individual students for persistently , occurring errors; again, 
most attention was, paid to errors in recently introduced or re- 
viewed areas of the language. Selection of unwanted items for\ 
remedial treatment was a function of error frequency, dispersion, 
persistence of occurrence, and thei severity of impairment of 
communication by a given <5rror. 

Subsequently, the instructor decided whether the error dis- 
persion over a nujnber of /Individuals warranted full-group, part- 
group or individualized remelfe.al work, and prepared appropriate 
materials for cognitive review, manipulative, or communicative 
practice; Here it was important that a different approach to 
explanation and/or practice be taken to increase the chances for 
success of remediation. 

Instructors were asked to keep a log of the type of remedial 
action selected and its apparent Effectiveness and efficiency , \ . 
for their own uscf in planning the course in subsequent years. 
They also solicited comments from their students about the reasons 
for improvement or for no improvement as they saw them. In this 



manner^ the feedback cycW on the effectiveness of instruction 
was closed at the instructor. • , 

Eliminating errors in the performance must^ at some point, 
involve an examination of the possible reasons for the occurrence 
of a given error, although the question must be left open at 
this point hew causal error analysis can be most helpful for 
actual classrpdra use. A number of meaningful explanations have 
been offered, in addition to the methods suggested by CA, to 
account for the occurrence ot errors (e/g. DuSkoya, 1969; George, 
1972; Richards, 1971; Selinker, 1969), but for the present at 
least, the teacher must decide in each instance whether an error 
was a performance slip or a competence error; he must ask him- 
self whether the elemerit to be learned was incorrectly perceived 
and incorrectly incorpqrated , or was it insufficiently practiced? 
Which one (or .lore) possible explanations can be given for 
wrong incorporation or externalization? Some errors may be re- 
ducible to native language interference, others to non-cognitive 
factors in the student,- others again to conditions in the laming 
environment. Consequently, the teacher as a practitioner must 
remain undogmatic and mu^pt test out for himself how langu^^ works 
rather than accept uncritically a theorist's convictions. 
Evaluation 

-It has-been difficult to reconcile the current professional 
demands fpr as much meaningful practice of the foreign language 
in the classroom as possible with the demands for valid and re- 
liable evaluation of communicative and linguistic competence 
demonstrated in such situations. An enormous amount of work has 



been done in conceputualizing the coramunicative competence di- 
mension and its evaluation (e.g. Bauer, 19 71; Noss, 1971; »Di" 
Pietro, 1973; Francke, 1972; Clark/ 1972; Smithy 1971; Jorstad, 
1974; Labov, 1970; Oiler, 1972; Cooper, 1970; Upshur, 1971; qarroll 
1973; Nickel, 1974; Spolsky^ 1968; '^akohoyity, 1970) ; yet it 
was concluded by Brie.re in 1971 that "what was missing then was 
a truly valid test to evaluate communicative competence. And 

K - ' ■ 

I ' ' ' 

Without doubt, the situation hasn't changed inuch: it is true that 

more and more imaginative testing situations for communicative and 

linguistic competence have been devised (discussed in Clark, 19 72, 

pp. 222-^28) but evaluation has tended to be subjective and global 

in nature because of the dif ficult.^* es involved in properly eval- . 

uating-an ongoing interaction. For example , many writers (e.g., 

\ ■ ' ■ -a ■ ■» * 

Riversi 1972, p. 28; Francke, 1972) urge that mistakes should be 

■• * ■» * ' ■ 

noted/ but not corrected during interactive practice; frequent/ 

mistakes could be discussed with the student privately or could 

be used as the basis for drills. 

. In the face of this dilemma it is quite possible that some 

teachers may either have given up on teaching for or evaluating 

communicative proficiency at alX because it doesn't l^nd itself 

to objective assessment as well as* do other ^testing approaches 

or they may have attracted the students' and/or department head's 

wrath for giving marks which were too high or^too low. 

Performance analysis as described here offers the teacher 

some benefits in this area for designing instructional sequences; 

three major sets of coticlusions emerge from the foregoing dis- 

* "• • '• ,» 

cussion: ' . * " . 



(1) Performance analysis combines the record-keeping and 
up-dating capabilities of computer-assisted instruction with 
increased communicative proficiency by me^ans of meaningful prac- 
tice? error files are produced which allow performance-to-per- 
formance comparisons of. progress of individuals or groups of 
learners. Remedial instruction 'following performance analysis 
offers branching advantages similar to those obtained under 
programmed instruction with which the students can be brought 

|to a comparable leyel of achievement. The instructor and the 

i ■ 

■students know at any given time with hi'gh reliability which level 

of linguistic competence has been achieved and which effects, if 

any, instructional and remedial strategies have had as measured 

in terms of ^ their effectiveness and efficiency. Statements of 

performance objectives such as "the student will be able to use 

inverted word order in ^unstructured writing to a criterion of 

80% accuracy" can easily be validated by performance analysis. 

» ^ ' ' ' 

Does the compiling, feedback and remedial. treatment of'errors 

as described here produce improved performance? This cguestion 

cannot be answered with ah unequivocal "yes" or "no" because com- 

^^parative empirical data are not yet ^available . "Yes", because 

a large increase in student satisfaction wii:h the course and 

learf^j^ng outcomes was reported; "yes" because in the major areas, 

a significant decrease in. errors did occur; "no" / remedial in- 

structioi} ,did not bring about a reduction of errors in all areas 

of the language, but this is probably the fault of inadequate 

remedial treatment, not of performance analysis itself. A 

further problem is the avoidance phenomenon v;hich is observed 
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when a student who is unsure about a linguistic form or its 
usage avoids it altogether; performance analysis |/ just like / 
error Analysis, as Schachter (1974) has pointed out, would provide 
no data a&'--to^jth^^ error status of that element. ^ 

(2) Performance analysis reflects the current emphasis on 
humani4^.ng learning!; i\t allows the participants in an oral com- 
munication situation to concentrate fully on the interaction it- 
self because they know that the taping will provide an accurate 
data base for cooperative assessment of the linguistic aspect 
of the performance;/ The instructor does not have to resort' to / 
furtive scribblj.hg, subverbal counting of errprs and other im- / 



press ioniaf^tid means of error collection. The students , on the 
other harvd, are involved in instructional design as they should 
be as Consumers. They know they are being evaluated fairly, non- 
punitively and - what is most important - constructively because 
they can judge their own perf orrqance from the same criteria which 
were available to the instructor for marking. 

(3) Performance analysis shows its greatest promise in. its 
capability to provide a data base for the empiirical measurement 
of the time and effort required to [overcome an error; (Ban athy 

f. ■ . 

and Lange, 1972, p. 80); in this mariner, item difficulty can be 
quantified,- and a pedagogical grammar can be written which or- 
ganizes instructional modules around learning problems on the 
basis of 3?eal, empirically determined item difficulty, not ac- 
cording to allegedly scientific criteria or the whim of a text- 
book author. 
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Neraser an^ Slama-^Cazacu X1970) had suggested that studies 
be made of large samples .of errors by the longitudinal method 
{viz. following a student or group ot students over a period of 
time in their "development of foreign language competence) and 
by the transversal method, that is by sampling students* errors 
at different stages in the learning process. The former method. 



\ — - ^ ^ 

of Course, produced the error profiles, and Illustration 9 
provides the results of a tabulation of error frequencies for 
Beginning, Intermediate and Advanced students. While the findings 
are far from L^ing unequivocal or conclusive, a pattern appears 
to emerge which parallels the development of course objectives, 
viz. increased versatility of expression, which :is more likely 
to lead to error3 than tightly organized first-year communication 
situations: many error categories whiqji, require close adherence 
to rules seem to become smaller in size while those where forms 
and usage are less predictable (e.g. semantic selection, spelling, 
gender) increase from the first to the third year. And yet, a 
commonality of error occurrences is apparent as can be seen in 
tne fact t^at'the first 13 error classes on the list account for 
roughly 50% of all errors on the three levels. . 

Further research could examine the relationship between the 



/■:■ 



frequency of use and frequency of correct use of aV foreign- Ian- 



IT) 



guage element on the various levels of instruction in, say, the 
ten most frequently occurring error classes. This analysis could 
be performed for use of certain items in speaking versus writing; 
pre li^hi nary eviderice collected here indicates that the effectiveness 
of remedial instruction . for the linguistic improvement of oral 
communication lags considerably behind improvement in written 
expression; . furthermore , such improvement is much more gradual. 

There are still problems to be overcome, of course. For 
example, supplying t^e number of errors without reference to the 
number of items used correctly provides only a very crude, class- 
room-use-oriented measure of the ef fecti ireness of instruction 
and remediation. Illustration 10 on the Handout illustrates the 
point that, in the given case, not only did remediation decrease 
the number of errors observed, it did so while, on the one hand, 
the percentage of correct usage increased and, on the other, stu*- 
dents used more of th(^se items. It is clear that for precise, 
measurement for research, not feed-back purposes, more sophist!-, 
cated techniques will have to be employed, such as have been de- 
scriT^ed, for example ,. by Buteau (1970) and Dulay and Burt (1974) 
in a study of Functors. 

Research must be undertaken to determine empirically some 
of the parameters of pedagogical grammars and tlieir implementa- 
tion in actual course designs, and it is hoped that .performance 

analysis qan make a contribution there. / 

/ ■ ' 

Manfred /Prokop 
DeparfcTtWnt of Germanic 
. Languages . 

. . The Uni/versity of Alberta 
Sdmonton, Alta* Canada 
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SYSTEMATIC PERFORMANCE ANALYSIS IN FOREIGN LANGUAGE INSTRUCTION 

AND LANGUAGE PLANNING 

(M, Prokop) 

Handout 

111. It Background InfoiTiiatlon 

Beginners Intermediates Advanced students 



Number of students' 
Text size 
Nuiober of errors 



21 
6,120 
815 



22 
12,281^ 
1,752 



19 
13,4 
1,5 



70 i > 

;57' 



111, 2: Excerpts from coding sheet 




Correct- -fcr«v\ 



^{u rp ,[ — - 
K;c.v\> f^c 



3^ 



(I 



t2L 



12 



IS- 



17 



ye 



2o 



Zi 



'I'L 



2C 



17 



2L^ 



30 



31 



12- 



33 



3H 



29 



907 



3€ 



27 




^2- 



213 





5^9 



Co? 


LxJ 
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G33 



111. 3s Error/v/ord Ratio 



Assignment: 01 


* / . 


Number of words : 


71 Number of errors: 5 


Error/word ratio 


* 100 =7.04, which means that there were , 




7.04 errors per 100 words 



111. Ij.: Individual Error Profile 



Code 


Assignment 


Actual niomber 
of errors 


Percentage of 
total number 


Verbal 

descriptor or code 


409 


02 


1 


6 . 25 


Correct position of 




04 


1 


8.33 


inflected verb in the 




05 


2 


22.22 


subordinate _clause . 


i 


06 


1 


7.14 















111. 5: Error Clust er Profile 



Assignment 


Number of occurrences 


Cluster 


02 


■4 


23: Correct word order 


04 


5 




05 


2 




06 


2 





111. 6: Individual Error Summary for the I^aat Sampling 



Code 


Assignment 


Actual number 
of errors 


Number of 
students 
making 
the error 


Percentage 
of total 
number 


Verbal 
description 
of code 


401 


06 


5 


3 


. 5.26%j 


Cor'rect position 
of verb in main 
clause , 



HI* 7: Error Cluster Summary for the ^aat Sampling 



Assignment 


Number of 
occurrences 


Number of' 
students 


Cluster description . r 

/ 


06 


20 


4 


.13: Correct form of a word . 




in the nominative or 








accusative plural 
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111. 8: Cumulative Error Summary 



Code 


Assignment 


ACI 


i^u.al- nujnber 


Number of 


Percentage 


Verbal 


• 


Of 


feirrors 


students 


of total 


description 










making 


number of 


of code 








■ 


error 


errors 




111 


01 




6 


3 


4.41 


Correct 




- 02 




2 


2 


2.44 


ending of 




03 




3 


3 


1.53 


rtoun in the** 




' 04 




2 . ■ 


1 


^0.92 


nomi native 




05 




■ 6'- ■ ' 


4 


6.74 


or accusative 




06 




5 ^ 


3 


5.26 


plural 

ft. 



Ill» 9: Error Frequencies ( written work ) for 3 Instructional Levels 



Error Code 



Beginners 
(N=8l5) 



Spelling 

Inflected verb in main sentence 
Semantic select ion: Jsituatloiial 

context 
Noun stems and suffixes 
Inflected verb in subord. clause 
Endings of ein-v7ords 
Endings, of der-words 
Preposition selection of verbs 
Semantic selection: translation 
Correct uninflected verb^f orm 
Ending of unpreceded adjectives 
.Repetition of spelling errpp 
Capitalization 

Agreement between subject + verb 
Conjunctions 
Use of article 

Adjective endings after der-word 
Suffix in Simple Past 
Adjective^nding after ein-word 
Relative pronouns 
V/prd linking 
Past tense stem 
Use of Past 
Gender of 'noua 
Choice of prefix \by Verb 
Case ae^lectlon of. vepb 
Personal pronouns ' 
Preposition selection of noun +ad. 
False passive i 
Agreement betvreen noun and pronoun 

replacing It \, 
Subjunctive 



Q.2!fo 

7.9 

6.6 

6.3 

5.3 
I4..I 
3.1 
3.0 
2.7 
2.6 

2.3 
2.1 
2.1 

2;o 

1.8 

1.8 ' 

1.7 
1.6 

^•5 

1.5 
1.0 



ERLC 



71+3" 



Intermediates 
(N=l,752) 



10. 

lu 

2.8 

6.3- 

3.3 
3.2 
2.1 

4!- 

.45- 
1.9 

1.0 

1.8 
1.3 

■j:- < 

1.1 

l|..l 

2.2 

2.1 

1.2 

1.6 

■M- 



Advanced 
(N=l,^57) 



10. 
6.6 

2.1|. 

i.b 

1.6 

2.5 . 
6.0 

1.2 

2.2 
l{-.3 

14 

1.0 

•«• 

3.i^ 
3.2 
2.1 

«• 

2.2 
1.7 
1.2 

1.0 . 
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frequency of less than 1% 
Qt the total 



111. 10: Number of errors and percentap!;e \ of correct usage of 
adjectives after der - words ( Beginners ) 




0^ = 



total number, 
of occurrences 



' taughtr remediated remediated 



7 



/ 



24 



